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INTRODUCTION ' ■ ■ . 

The purpose of this evaluation report fs to provide "an Interim review 
of a two-year pilot program, the Individual 1 zed -Study Program, coordinated 
by the UC Dav*s Learning. Ski 1 Is Center. The. Ind1v1 dual 1 zed Study Program 
(ISP) was -Implemented "during the 1981-83 academic year ^Uh the major objec- 
tive of enhancing the retention of. selected students who exhibited severe 
basic academic skills deficiencies. 

Program description : For the 1,981-82 academic year, students, selected 
to' participate in TSP were allowed to reduce their academic unit" load to 8 
or 9 units with the stipulation that 9 to 12 hours per week be spent Improv- 
ing basic skills through self -paced coursework, lab work or Intensive coun- 
selor assistance at the Learning Skills Center (JSC). (The 9 to 12 hours 
per week are equivalent In time to a 3 or 4runit laboratory-course.) 
Although no academic or work load units were earned for work at ISC, program 
participants were considered full -time student s^nd maintained their e?1gt r 
biHty for financial aid and other campus services. 

The target ^group of students for rSP participation were EOP students 1 
entering in Fall 1981 as Special Action 2 students. These students were 
Invited to participate 1n the Special Transitional Enrichment Program (STEP) 
prior to their enrollment to UC Davis. 3 . ' 

The objectives of STEP are (1)- to assist underprepared studeats to 
strengthen their learning skills and study habits 1n areas where Improvement 
Is needed, (2) to enhance, students' readiness to do University work by 
providing a Week of orientation and three weeks of instruction prior to the 
fall quarter, and (3) to assist students' adjustment to UC Davis by pro- 
viding ,T1v1ng/f earning experiences 1n residence halls and general orienta- 
tion to campus life. Thus, ISP represents one of several academic year 
extensions of STEP 1n Its objective po enhance students'. readiness to do, 
Unlyerslty work and strengthen their basic' skfTls. - v " 

i ' * *' 

i 

There were five program selection cr1 terl «T<^r 1981-82 Wpartld- 
pants. 



. * 

The Educational Opportunity Program 1s designed to assist and .provide 
opportunities In higher education for students from economically/educa- 
tionally disadvantaged backgrounds. 

4 

The Special Action admission category Includes .students who have not 
jnet UC entrance requirements, but who have demonstrated academic poten- 
tial.' ' ' 

For more information on STEP see: "Study of the 1978 Summer SffEP." 
Suhr, Jeanne. Office of Studfiht Affairs Research and Evaluation. 
October 1980. University of California, Davis.. ' . 



Fall -Quarter, ISP : . . , 

« \**a.* students who participated In Sumner STEP but whose diagnostic test 
* scares and performance indicated a need for continue^ intensive 
assistance, and . • * 

b. • students who were granted a waiver from Summer STEP participation. 

Winter and Spring Quarters JSP : n 

\ - . • *v 

a. students who participated in ISP Tor one*or two quarters but whose 
diagnostic scores and performance Indicated a need for continued 
Intensive assistance^ '* ' • \ 

t>. Special Aet1on/E0P students who had not previously participated In- 
sane pilot program, but whose academic performance indicated a neeo* 
for Intensive assistance, and % , • 

. . « 

c. other Special Action students who requested assistance. ^. ■ • 

* • - • "* *.•• • 

In addition, there were two levels of I SP r participation available to 
'invited students! Formal «ISP participants both reduced the1,r study load 
(less than 12 units} and received. Intensive counselor assistance; Informal. 
ISP participants maintained a fyil 1 study load (more than or equal to ft 
units), but received Intensive counselor assistance. 

Participation tn ISP" was voluntary. Students meeting the selection, 
criteria were contacted by the ISP coordinator, who reviewed With the stu- 
dent his/her past academic record and explained the requirements and advan- 
tages of the program. If needed, the student completed a reading exam**, 
mathematics exam a.nd essay exam to determine the level and area of basic 
skllTs development' needed. Based on the results of these exams and the 
Initial Interview, an Individualized study plan was developed for the stu- 
dent. If tire student chose to be a formal ISP participant, the student's 
schedule was stated 1n the form of a contract /and sJghedflLthe stugent, ISP 
coordinator and an EO*counselor. (See Appendix A for ^^am-pje contract.) 
The contract obligated the student to participate fully 1n., ISP. and to for-v 
felt full -time student status if the xon tract was violated. „ (Viol at ion Is 
rdeflned as less than a 90% attendance rate In scheduled , basic ski] ls/ISP 
coursework hours. Students were monitored throughout tjielr ISP" participa- 
tion for attendance and progress 1n the program.) In some cases, students 
InvHed to be IS? participants chose to be informal participants and a^ 
contract was not' formalized. These Students received intensive counselor" 
assistance but did not reduce their study Joad. • 

A variety of services and course offerings was available to the student 
in the development of his/her ISP schedule. (Appendix B lists the general 
offerings of ISP.) A typical program included a combination of attendance 
at appropriate ISP workshops throughout the quarter, self-paced skills 
development 1n the LSC Learning Laboratory, weekly appointments with a LSC 
counselor to work on areas of most difficulty, and periodic sessions with- 
Counsel Ing Center staf.f»to discus* career ^joals and adjustment to campus 
Hfe In general. " * * . x 



An early warning system for ISP a.ndsnon:iSP participants was *lso' 
developed as part of the ISP" monitoring responsibility. Through the cooper- 
ation of the'UC tyivis Registrar's Office, academic performance redords of 
students Identified as potential I $P participants were collected Immediately 
after the end, of the quarter. These records were- "reviewed* tjy the ISP 
coordinator; students In academic difficulty were contacted before cTasses 
began for the following quarter and Invited to participate 1n' ISP. 

MEASURES OF PROGRAM IMPACT y \ \' ' 

The current study examines the following question: 91 d the reduced 
study load and Intensive learning assistance affect student .academic parti- 
cipation and performance? Because ISP was designed to provide Intensive 
remedial assistance, the actual use of tutoring, workshops, and^resiedlal 
^courses are one measure ef student tnvolvement in laild "tompHaoce! >ith the 
program. -Thus, two measures of program participation were: (i) total 
number of tutoring hours used throughout the student's 5 first three quarters, 
12) number of workshops attended*, and three measures of program Impact were 
(1) number of successful (courses with grades df^C** or better or a passed 
"P" grade) remfdiai math courses taken, and (2). number of successful reme-* 
di a> Engl teh-courses taken f and \ 3)/ student academic # stand1ng (1.e„ pfoba- ' 
tlonary dr good) at the end of. the> first three quarter^ enrolled. 

In order to determine the program ef fectydST student performance, two 
pom pari son groups of similar students were tderftlfled. The first comparison 
group contains EOP students who had been admitted by Special Action 1n the 
previous year, attended Summer 1980' STEP (or recel ved-a,wafver), and had 
access to services and course offerings similar to thoseJ|pr ISP partici- 
pants. The second comparison group; Included Fall 1981 Special Act1on/E0P 
studentfs Invited to partlclpaj-elin ISP, who declined program services. 
However, many of the students in. *h1s group did receive academic counseling 
•from the ISP coordinator which reWrtefl 1n major class rescheduling -dfr study 
program changes. t " 

Each comparison group brought with 1t advantages and disadvantages; 
The Fall. 1981 non-ISP group, although "contaminated" beciuse'Of the Initial 
ISP contact, Is comprised of ISP cohorts,. a fact that controls for time of 
.entry to the University and other time-related Variables. "The Fall 1980 
group, on the other hand, had no access to ISP.; thus, any significant 
differences, between the , Jail 1980 and ISP groeps may be attributed 1n part 
to ISP. Howeve^these comparison result sare lliH^ted^ue to differences 1fi 
entering characteristics between these two jroups. ) - 



. . . • <i 



♦Workshops must be defined for. these comparisons. For the most part, ISP 
students attended special Workshops designed for ISP participation which 
differed from LSC wqrkshops. The difference was both in the pace of the 
material covered and the ratio of student-to-ihsructor, ISP workshops were 
smaller which allowed for a closer" 1 1a1 son between student and instructor, 
and slower 1n pace. However, workshop topics and focus on remedial assis- 
tance were the same for LSC and ISP programming. 



* Analysis of the program Included comparisons among four groups: formal 
. ISP participants, Informal ISP' participants, Fall 1980 comparison group, and 
the Fall 1981 non-ISP comparison -group. The major differences between the 
comparison groups and the ISP groups we're the reduced study load and the 
intensive ISP assistance. ' Specifically, 'these four groups received one of 
four different levels of program assistance: no assistance (Fall/1980 
comparison group), limited. counseling assistance (Fall -19^1 non-ISP Compari- 
son group). Intensive counseling assistance and workshop participation- (ISP, 
Informal), and Intensive counseling assistances workshop participation and 
reduction' 1n study load (ISP formal group)/ v 

Two statistical techniques (analysis of variance and ch1 -square test of 
homogeneity) were used In reviewing the comparison and program group data. 
The objectives of these analyses are to test whether differences between ttoe 
groups are large enough to represent more than random fluctuations. If there 
are no differences In outcomes* between the groups, or 1f the differences are 
very small (I.e., non-s1gnif leant results), then there is no evidence that 
ISP affected student academic participation and performance. However, as the 
differences between the groups become larger and the results are statisti- 
cally significant, then 1t may be reasonable to believe that the program- d^id 
affect student academic participation and performance. 

Table 1 shows the sex and ethnic composition of the four groups of 
students compared in the* analysis. * 
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" SEX AND ETHNICITY OF COKPARISON Al© ISP GROUPS r 
. f (In percent of students 1rr each group)" 1 [ 



A 









^ 




VFALi 

\ . 61 

• ^ (n« 

• .< • • * 


u 1980 
PRISON 

439) , 


♦FAIL 1981 
HON- ISP • 
GROUP 
(n-53) 

+- 


• 

INFORMAL ISP . 
. (n-24) ' 


FORMAL ISP 
(n-36) 


Sex" . <• 

» • * 










".Male 


a 

55 r 


55 


54 




* /Female n 
Ethnicity 

t 


45 

•f 


. 45 


46 


72 


/tanprlran Indian 


o 




0 


w 


Bljck 


34 


57 


46 


28 


Caucasian 

• 


14 


^ 8 


0 


22 


Chi cans 


\* 


8 


' 21 * 


14 


. ■• Asian 


24 


19 


33 


33 


• ■ 

Other and 
Decline to state 


V 

11 


6 







Major ethnic groups for the formal and Informal ISP participants "were Black 
(35%), Asian (33%) and tfilcano (17%); 62% were female. Of the Fall 1980 
comparison group, the major ethnic groups were Black (34%), and Chlcano ahd 
Caucasian (each 14%); 45% were, female; for the Fall 1981 non-ISP group, the 
major ethnic group was Black (57%)* *There were significant- differences 1n 
the number of male and female students 1n each group (x^«8^7, p<.05) as 
well as among the major ethnic categories of Black, Caucasian, Asian, Chl- 
cano and -Other" (x 2 »22.0, p<.05). 

Tftese differences may Influence program outcome because of the known 
•relationships between sex, ethnicity, and academic performance (females, 
Asians, and Whites attain slightly higher GPAs In college than do males and 
other ethnic groups). However, these general relationships may. not hold 
among this group of high risk, students. If they are Influential, the bias 
Introduced would be 1n favor of the formal ISP students because of hi.gh 
numbers of females, Whites and Asians 1n tnat group. 
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Table 2 detail s\ the f dfstr1 but 1 on ot STEP participants araf entrance 
levels by group membership. ' ' • „ m 



TABli 2 



GROUP MEMBERSHIP/BY STEP PARTICIPATION AND ENTRANCE LEVEL 

(In percent of students In each group) ^ 



GROUP 



TOTAL 
n 



SUMMER STEP 
COVETED "TOVED 



LEVEL AT ENTRY 
FRESfTOT "~ JBvTQICED 
STANDING 



FAIL 1930 COW AR I SON 
FALL '1981 NON-ISP 
INFORMAL ISP 
FORMAL ISP : 



139 


66 


34 . 


68 




32 


•53 


79 


21 


60 


y 


* 40 


* 24 


71 


29 


70 




29 


. 36 


81 \ 


' '19 


61 




39 



There were no significant differences /among the ^groups with respect to' 
completion or waiver of shatter STEP (x 2 -4.90, p<*20) o\ freshman or advanced 
standing status kt entry (x z -3.99, p<.30). 

Table 3 shows the (jlstrlbutfons of entering GPA by group membership 
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TABLE 3 

GROUP MEMBERSHIP AND (ENTRANCE LEVEL BY ENTERING GPA . 
(In percent of students 1n each group) 

. . , , ! ' ' 

FALL 1980 , FALL 1981 . 
COWARISON - ' MUi-ISP 

GROUP , . GROUP INFORMAL ISP FORMAL ISP 

ENTERING GRA Htph Trans- / , High Trans- High- Trans- High Traqs- 

School fer School fer School fer School fer 

' (n«96) (n«43) (n-32) (n«21) (n«17) (n-7) (fi-22) (n-14) 



3 .6 ~- '4 .0 




2 


0 




f 

0 


0 


0 


' 0 


3.3-3*59 


4 


30 


3 


5 


12 


0 


. 0 


4 

7 


3*0 - 3.?? 


28 


» 

23 


16 V 


5 


18. 


14 


14 


.15 


2.6 - 2.99 


38 


19 


34 


V5 


3S 


14 


V 


21 


2.4 - 2.59 


12 


?1 


13 


38 


23 


29 

* 


18 


21 


2.0 ^-2.39 


15 


5 


28 


9 


12 




36 


0 

i 


below 2.0 


3 


. 


6 


5 


0 


29 


5 

* 


0 


MISSING 








M 




14 


* 


36 


MEAN GPA 


2.8 


3.03 


2.57 


2.7* 


2.70 


2.16 


2.50 


2.86 



An analysis of variance test showed that there was no statistical 
difference among the groups with respect to entering GPA. Jtowever, the 
entering GPA of the Fall 1980 comparison group Is slightly* better than any 
of the other three groups.' Because the analytic methods used 1n this study 
do «not require matched characteristics or equivalent numbers 1n each group 
for comparison, the differences 1n group size and student characteristics 
should ^not Inhibit the\stat1st1cal results. However, the importance of the 
findings may be Um1tetf~because of the 'group differences (e.g. sex, ethni- 
city, entering GPA, summer ^STEP participation and entering class level). 

RESULTS OF THE COMPARISON ANALYSES AND TELEPHONE SURVEY 

The results ofthe statistical analyses stf'ggest'that there „fs little 
difference in outcomes between the groups, except that the ISP participants 
attended more workshops. That -1s, the ISP Intervention program ' (both formal 
and informal) did not statistically affect most measures of student academic 
participation or performance (as compared to the Fall 1980 comparison' group 

or the Fall 1981 non-ISP group). Althojugh there was no statistical differ- 

» • 



, 10 



0 



ence among the groups in tutoring participation. 1t was apparent that ISP 
students used this service to a greater degree than either comparison 
groups. 



tjfl These findings are not unexpected because full-time student statSs for 
formal ISP participants is dependent on the number of workshops in which 
these students are registered. For Instance, a majority of the formal ISP 
students chose a reduction, of only one or- two units'. But a reduction of 
even one unit required a three-hour commitment to LSC workshops, which can 
represent as many, as three one- hour workshops a week; this requirement may 
account for the significant results. ~ The other variables reviewed were 
tutoring, and successful completion of remedial math and -Engltsh courses. 
There was no statistical difference within these variables. 

Table. 4 shows the distribution of the number of tutoring and. workshop 
sessions each group of students attended during the .academic year as well as 
the. number of successfully completed remedial math and English courses. 
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TABLE 4 

■» — m \ 

* % 

NUMBER OF TUTOR INS SESSiQNS, WORKSHOPS, AND SUCCESSFULLY COMPLETED 
REMEDIAL MATH AND ENGLISH COURSES BY GROUP MEMBERSHIP 



NUMBER OF 
COURSES/SESSIONS 



* FALL 1980 . - 
Comparison Group 
(n-139) 



FALL 1981 
Non r< ISP Group 
(n-53) 



FORMAL 
ISP 

(n»36) 



INFORMAL' 

ISP 
(n-24) 



Tutoring' Sessions 

Percent attending 38 

Mean number of sessions 8.9 
tutored (includes only 
students tutored) 

Workshops * 

Percent attending 19 

Modal number of workshops 1 
(Includes only students 
attending) 

Successful Math Courses 1 

(number of courses) 

1 > -16 

2 '- 8 

3 ' .4 

m 

" Successful English Courses 2 



(number of courses) 

I .' ,. 
2 



25 
8.9 



54 
9.4* 



31 
1 



100 



3P9 f 
5 



46 

I2-.0 



.87' 
1 



•percent of students in- each group 

17 . 26 29 

6. 4 0 

* * 0 0 



•percent Of students in each group 

26 17 29 



1 Includes remedial Math B, C,' 0, Pre 16a, Co- 16a, Co-16b 

2 Includes English R and English A 



Any important, outcome measure representing academic, performance 1s stu^ 
dent-GPA. farngS^oses of this report, student academic standing (good 
staflftlng«&Aj| nd probationary stand„ing«6pA £1.99) was measured at the 
conclusioa.«j ftudent's first three quarters. Based on academic stand- 
ing at the enWRhrpe quarters, formal and informal ISP participants", did 
not differ from the Fall 1960 or Fall 1981 non-ISP comparison groups nor dtd 
they differ from each other (x z »2.96, p<.70). Table 5 lists the number of^ 
students by academic standing and third quarter GP^ for each group. 
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■ - , TABLE 5 . 

CUMULATIVE UCO, SPA Al® ACADEMIC STAKDIN6 AT 
THE EM) OF THREE .QUARTERS BY fiROUP MEMBERSHIP 
( In percent of students 1j^ each group) 



7! 



UC GPA 



FALL 1980 W 1961 

1 son -Group Non-ISP Group 
n- 139) * (n^53> 



. asp 

.(n-36) 




3.3-3/59 

3.0 - 3.29 ■ 
2.6~ r 2*99, 



2.4 - 2,59 
2.0 - 2.39 ♦ 



w Total Percent in, Good 
Standing . 




m 

Probationary 
<1.99^ 



standing 



•1 



INFORMAL 

ISP 
(n-24) 



1 


-.4 ., 


0 


/ ° 


5 


4 

■ 




4 


Z , * 


... V'VX 


3 ' 

« 


: 4 


16 


30 . 


8 


8 


6 




• 

• 19 


0 










29 




17 


* 33 






50 


50 


* 






41 


\ 38 


50 

■ ' < 


50 



f - ' In addition to Vhtfse statistical analyses, a telephone survey was 
conducted to assess the ISP participants' reactions and perceptions of the 

v Program and student 1 life at UC Davis. (See Appendix- C for a copy of the 
questionnaire.) Of the 60 formal and Informal students, 32 (53%) responded 
to the survey. Because the telephone survey was conducted at the end of the 
spring quarter, there was difficulty In locating current phone numbers .for 

jthese students as well as contacting them before summer vacation. Of those 
Students who were contacted 'and refused to participate, reasons included the 
Tack of time or interest in answering the survey* and difficulty 1n under- 
standing English sufficiently to answer a survey over the telephone. 

The four most Important personal goals of these students '1n attending 
college are: (1) to increase their knowledge ami understanding 1n an aca- 
demic^ 1eld, (2) to formulate long-term career plans and/or goals, (3) to 
prepare for a career* and (4) tc^ obtain a degree. Many of the respondents 
felt that through ISP, they had been able to accomplish some of their goals: 
"Making 1{ through my first year"; "I'm doing good 1n college"; "I. now have 
experience about college"; and "So far, my math skills [are 3 way up." 
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More Interesting were the students 1 responses to questions regarding 
tne effect the program Had on then. Here are .sone of the most frequent 
consents.' , 



"A 11/e jacket to a dropping person.* 



"A .lot,- helped me w1tb>mat£, vocabulary and English weaknesses and. 
writing skills/ 



"Helped me with classes— especially math, chem." 
"Incentive, confidence." 



•Wery. important to a person who has been out of school for a long.tlmevt 
1t helped me get beck 1n the 'swing of things." • • V 

"One-to-one tutoring really helped— did not feel stupid asking ques- 
tions." , ••/'.' '* : • ' 

Students were asked what, If anything, they felt was lacking In ISP. 
Several students commented: * "Nothing, taught a lot." There Were some 
students who felt that the program should be 'broadened to 'include more than 
basic sMlls and should be available to all studerits. j ;\ 

*■'*•'' 

During the survey, students dtscussed the problems they had encountered 
since coming to UC Davis. The following 1 1st describes .the most frequent 
and frustrating problems* 

"Very frustrated adjusting to jc system— one department doesn't know 
anything about anyone else, (especially Financial Aid); Work-Study peo- 
ple who don't know mucfc of what Is going on an'd make you run'around 
entire school." 

"Problems meeting peopl^, ISP helped: social life— nothing to do." 
"Math was a nightmare." ' " * 
"Endless problems with Financial Aid." 

"Adjusting to college life and classes, how 'to approach professorsS" 
"How hard 1t 1s." . 

♦ * 

f M Study habits, speed of classes 1n the quarter system." 4 

, Students also noted the biggest problems -thej&felt they had to resolve 
before coming to UC Davis. These problems InclUdSt: "Adjustment to school 
with family 11.fe"; "Leaving home, being Independent— adjusting"; *Wdrr1ed 
about money problems, financial problems"; and "Whether I realty -wanted to 
be In college on not, confidence." • 

CONCLUSIONS ^ 

- • '" ' . ' * 

it seems apparent that the Individualized Study Program was successful 
In identifying and contacting potential ISP participants, and In providing 

12 
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-Intensive »basfc skills development assistance. A1.1 ISP participants main- 
tained a- 90% attendance rate. Of particular Importance Mas' the development 
of the "early warning system.* The system proved to be extremely useful . In 
Identifying quarterly academic problems with Special Act1on/E0P students 
befdre problems were compounded by further unsuccessful coursework. it 1s 
anticipated that, through the early warning system, the retention rate of 
these -students may Increase oyer tlmei 

* • 

*The effects of the program oh student performance are less apparent. 
There ate Several da ta>1 Imitations to the current study that may havet af- 
fected these evaluation results.' *The most Inhibiting data 'limitation [was 
the lack of better comparison groups. The characteristics unique to u he 

.Fall 1980. Special Actlon/EOP group say have been influential In the sWt 
dents' first year performance. For Instance*, the Fall 1980 entrants may 

vhave been more mature tfr motivated than the ISP group. Based on entering 
SPA,* 1t is apparent that these students were better academically prepared 

' than the ISP group. There was no comparable diagnostic test Information' 
available that could ber used to refine the comparison groups. .Although the 
Fall 1$81 non-ISl* group Is a more comparable, 1t 1s possible their academic 
-participation and performance was influenced by early ISP contact. 

* Another problem may be the short time parameter used 1n reviewing the 
effectiveness of the program. That 1s, the benefit of the Intensive reme- 
dial work and/or reduced study load options may not be observed until the 

student's second year at UC Davis. * 

* r * * 
• •%«.♦ 

However, based on the short-run (first three quarters) outcome, the 
comparison between formal ISP and Informal ISP students did not reveal, any 
significant differences as a result of the reduced sttrdy load option. In 
addition, the comparisons between the ISP groups and the Fall 1980 and Fall 
1981 non-ISP comparison groups did not show any differenced academic 
.performance due to the reduced study load option and/or Intensive learning 
assistance methodology. . 

» The acknowledgement of these study limitations do not ^entirely explain 
the reasons wfty ; ISP showed so little Impact on Its participants. Perhaps an 
additional question tb answer 1s whether it 1s the program or the student; 
that Is responsible for the lack of a more successful outcome. That 1s, the 
target population .for ISP service has been Identified as extremely high-risk 
Students with sufficient basic skills deficiencies to endanger their per- 
formance at UC Davis. r These students represent a mixture of di/ferent* 

levels of educational, development, backgrounds, basic skills problems, and 
different, motivation and maturation levels. According to discussions with 
ISP staff, each entering class of freshmen and advanced standing students 
ytelds a different composition of motivation and academic basic skills 
ablttty. ISP participants who exhibit a higher level of motivation to 
succeed at co1|ege and/or have better, although insufficient basic skills, 

.will probably benefit more from the ISP program then students with Tower 
ambitions. For some ISP students, their first year performance ^was compa- 
rable to regular admit students, but a substantial number of ISP students 

did not fare as well. • 

■ - » , «* 

Based On^the results ofVthls Interim evaluation report, four recommen- 
dations can be advanced. » 

*» , m / * 

. ' * - • 



The program ihouYd continue through the second year with specific 
attention on the effect of the # early warning system. What effect does 
the early warning system have as a preventative method to student drop- 
odts? Does the earT^ warning system provide an avenue for ISP to. 
'contact students^tor academic counseling and assistance in a timely and 
efficient manner? itow do students perceive the early warning System ~ 
how helpful Is 1t to them? Can Xhe early war^logsysteis be applied on 
a larger scale to alKEOP students? - 



A better comparison group should oe used In future evaluations. -Ear 
Instance, random assignment *of high risk students to the program wouK 
help. In the coordination of a better comparison group. This procedure 
would' control for entering "characteristics and- result in* more suit- * 
able comparison group. In addition, application of standard pre* and 
post-tests^ would be useful in the isolation of .ISP remedial course 
effectiveness. 

The long-term effect of the program should be assessed. 1981-82 ISP 
students ^should be tracked during their second year at'UCD. 

Program reassessment of the target population -J s* suggested. % Students 
within the target population who are at less risk but with' some basic 
skills problems may benefit more from the program. Although this 
program attempts to assist all remedial nqed Jevels of students, Its 
success Is largely dependent on the students' motivation to succeed at 
college. Thus r the success of the program 1n Its first year nay hot be 
the most appropriate' point to measure program. 1 mpact. Selection of. ISP 
participants and method of service delivery should be reviewed In the 
r second year. ^ - 
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RESPONSE TO EVALUATION FINDINGS . % . , 



December 20, 1982 





TO i Alice Tom 

FR s Virginia Martucci 

HEi INTERIM EVALUATION RBBDRTs 

INDIVIDUALIZED pTODY PROGRAM ^ 

> • ■ • " 

Per your request, following are the program's responses to the 
referenced report? , 

f 

A. Body of the Report • * , 

1. The ISP* staff and I very roach appreciate your efforts to unearth 
a viable comparison group for ISP participants; however, we be* * 
lieve that the fall 1980 STEP students pose a substantial dif- 
ficulty as a comparison group* Although the mean entering CPA's 
between that group^and all others wejre not significantly higher, 
the. GPA distribution within each group was quite different, with 
71% of, the Tall 1980 freshmen entering with at least I 2.60 GPA 
compared to only 65% of the informal ISP group and 41% of the 
formal group. Similarly, 74% of the 1980 transfers entered with 
at least a 2.60 GPA compared to only 28% of the informal ISP 
, transfers and 43% of the formal transfers {see table below) . In- 

addition, the Fall 1980 group includes students -who never experi- 
enced academic difficulty at CCD, whereas v all students in' the 
other groups, except those selected froa Susmer STEP students who 
had not yet taken OCp courses, did poorly in at least one UCD 
t course. Thus, the Fall 1980 comparison group would seem tq have 
been at considerably less risk than any of the other groups. 

PERCENT OF STUDENTS WITH ENTERING GPA OF AT LEAST 2.60 



Fall 1981, Informal Formal « 
Fall 1980 non-ISP ISP/ « ' ISP 



High School 71% 53% 65% «. 41% 

Transfer 74% 29% 28% 43% * 

2. We also cannot help believing that the degree to which the 
• Fall 1981 non-ISP students represent a "contaminated" compari- 
son group is understated. Many of these students changed their ' 
intended Winter or. Spring Quarter course, schedules as a result 
of the ISP early warning system. \ As .you know, the early warning 
system distinguishes our reduced study load, program from all 
others in the UC system and may very wqjLl be the most significant 
aspect of ISP. Because the early warning system impacts on jthe 
^advising process, a critical] factor in the retention of special 
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action .students, Che staff and I .believe 1 that any student who 
altered^ his/her schedule as a result of the system was, in fact, 
an ISP participant — particularly when "one takes into account that 
only 22Z\of formal ISP participants reduced their study load below 
10 urfits,' with 52Z reducing their study load by 1 unit at most. 
In other words, the difference between over half of the formal ISP ' 
participants and the Fall 1981 non-ISP comparison group Is rela- 
tively slight. \ We, therefore, wonder whether the intensive ad- 
vising given* the FaUsJ.981 non-ISP group, all of whom had experi- 
enced. some degree of academic difficulty, has received sufficient •'• 
emphasis as it<-may account, in part,, for that group* s having ex- 
perienced a 38Z probationary rate compared to the 4;tZ probationary 
rate experienced by the Pall '1980 groap, many of whom had not ex- 
perienced academic difficulty. This seems especially probable ' 
given .Che fact that 7 IX of the Pall 1980 freshmen entered with at > 
least a 2.60 CPA compared to 53Z of the Fall 1981 non-ISP fresh- 
men, and 74Z of the. Fall '1980* transfers entered with at least a . 
2.60 GgA compared to ."only fc 29% of the Fall 1981, non-ISP transfers 
(see table above) . . ' * "*\ ^ 

3. Although most formal ISP participants did fulfill their Contracts, 
' two did not and were subsequently denied the ISP minimum progress 

waiver by the College of Letters and Science. These students 
xjv should thus not be Included among the .formal participants. Their . 
exclusion would reduce the probationary rate for that group to 471, 
rather than*50Z. /Overall, however, it would not alter the proba- 
tionary rate for iSP participants, formal and informal, as a whole 
as shifting these to the informal group would raise that group's 
probationary rate from 50Z to 54%. We, therefore, comment on , 
these students ^ily for the sake of accuracy. 4 • 

4. While English 25 is not considered a remedial course -and is i 
therefore not included in your listing In Table 4, we would like 
to note that five formal ISP participant^ 'successfully completed 
that course. 



B. Recommendations 



J 
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1. We fully agree with recommendations one and three. We would like 
to suggest that the Office of Research and Information' determine 
which, data elements will be needed to assess the early warning 
system so that we can be sure to have the information available 
in a usable format. *.;?, 

2. While we £gree* that a better comparison group is needed , we cannot 

* support recommendation two. Ts ocv-so would, in our opinion, defeat 
the purpose and spirit of the program. The "Report of the UC Davis 
task Force on Retention and Transfer" has already shown the likeli- 
hood of academic success for the population Involved in the absence - 
•of additional intervention strategies. In light of the evidence 
provided In that 'report^, we simply could not deny program services 
ly student with so little chance of succeeding on his/her own. * 
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"success 11 rate, it would also ignore the^entire, rationale for 

ISF< — to reduce attrition among academically high-risk populations. 

* — « 

' v . ** 

Finally, we would like to notetpur general^sense of the difficulty, 

perhaps impossibility, of evaluating a program like ISP in « the 'usual statls- 

. tical way. By its vary nature, ISP attempts to deal with each student as 

Cu Individual. Very often, the reasons for a particular student's success / 
r* failure are indeed complex and go far beyond what ^ < purely/ statistical 
approach can consider. As the students' responses to the ISP Telephone Sur- 
vey indicate, their frustrations, are many; their lack of self-confidence ' 
sometimes acute, and their need for Support, both academic and non-academic , 
apparent. Because factors such as these had also been noted In the task Force 
* report, ISP was conceived as^ a mult t-f acted program involving not only academic 
skill. building, but personal counseling, 'financial assistance, academic ad- 
vising, timely intervention — in* short, a range of needs, with the ultimate aim 
of* Increasing the retention rate of special action students over tlfn. Ideally, 
we feel the program should^ be evaluated using a case history method. Such a ✓ 
' method would not only be congruent with the program's concern for the Individual 
student, it could also provide Information useful both to program planning end 
to acquainting the campus community with the complex reality, rather than just 
the generally assumed academic inadequacy, responsible for the retention rate • 
r of special action students. Because we recognise that such a study J)| probably 
not feasible, we can only stress our agreement with tecctmendation" three: "The 
long-term effect of the program should be assessed." We would, however, add 
that the assessment should determine, whether or not the program has succeeded 
In its goal' of increasing the retention rate of special action students over ' 



Thank you for th£f opportunity to respond to the report. 

VFM:ajs , 
cc: Yvonne Sanchez 
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( ■ . . INDIVIDUALIZED STUDY R06MN CONTRACT - . 

* '2 . * . » . 

/ • • . . 

Tb« Individualised Study Prograa off tan Special Actios etudes ta cn opportunity to 
take fewer then 12 unite la a gives quarter, while- retaining the level of financial 
t aljjl fot which the y have c jealifladft, Tbi a. opportunity ia provided with the followlog 
Stipulation; TEE STUDENT MOST MUXES TO SPEND t BOOKS (If TOT .STUDENT IS TAKTNC 9 
COURSE UBTTSJ OR 12 HOURS (IF THE STUDENT .*§ TAKING 8 COURSE IWITS) PEST SEEK PURSUING 
AN WDIVHtoALIZED COURSE OP STOUT AMIL.COUMSELIMG AT IBB LEARNING SKILtS CENTER. MORE- 
OVER, THE STUDEN T j£ REQUIRED TC'PULLY PARTICIPATE IN RXB/BBR PROGRAM EACH WEEK. POLL 
* PABTICIPATIQNjIS DEPIMED AS AT LEAST 90S ATTENDANCE AT ALL ACTIVITIES AMD CLEAR EVIDENCE 
W EPPORT. PAXLORE TO P AETICTPATXPULLY WILL KESOLT IN THE ALBERT'S WtK DROPPED 
FROM TBI PROGRAM* BECAUSE STUDENTS HBO ARE DROPPED PEON TEE PROGRAM WILL ROD MEET THE . 
MINIMUM PROGRESS REQUIREMENTS OF THEIR COLLEGE, TREY WILL ERDANGER TNBIR ACADEMIC 
STANDING AT THE -OW VERS ITT. *. • . 



I agree to fully participate (at leant 90S attendance, and clear evidence pf effort) 
in f he InaividB^llrad^tudjr Progran outlined below during Quarter ffi . 

• » • . ■ . • - 

A. General Offerings 

1. Study Skill* Tft€taiquM~~l hour pmv mk f plus 191 ttddlcloul hou* 

% 7 during t#*«ks 2. 4, md 9 

2. Croup Orl«Jtattioo*S«ai«ioM~l-l/2 hoars p«r v*mk, plus individual 

* X follow-up m M«d«d 

• * .- 

B. Special Topics Ottering* K . , 

1. • 



2. 



TOTAL WEEKLY COMMITMENT — HOURS 

I undeTetend that failure to follow-through on ny egreeaent will reeult in ny being 
dropped frost the progran and sot neetlag the adnlaun progreaeiWquireeunflf of ny 
collage % 

* . STUDENT SIGNATURE: " ' 

DATE: ' " 

/ ■ . ' 

EOP COUNSELOR SIGNATURE: ' tf 

LSC COUNSELOR SIGNATURE: , ■ 
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x»rom&ais» s nag P Bogum 1 * I 
• fissounrni or otferxugs 

' T V [ 

* - * ' * 

Sffiggg 9tfjU%9 5 ' 

r 

1. Study Skills Techniques 

.Counselors: Patricia Herthel end Maria Mltcbua 
" 'Time CoMltMats 1 individual hoar per vttk^ plus 3 additional group 

session* during weeks J, 4 9 end 9 
Description: Q» en individual beoie, students will leern to apply 

affective study techniquee: time management # note~tcklng 
(lecture «nd text), listening, exa^-taking (eesey end 
' objective) , and memory strategies. Croup eeselooe will 

&v»* the principles of tine management (week 2) , prepering 
m for midterm examinations (week 4) \ snd preparing for final, 
examinatlone (week 9 ) • 

• . / * 

2. Group Orientation Sessions w 
Couneelore: Gary Perkins* Naomi Safcal, Barters Teflor 

Time Ccmacitnent: 1-172 hours par week, ploe individual follow-up as needed 
Case rip tim: Groups will discoas ths following topics; perstmal adjustment 
to taapue Ufa; forming a supporclva network peers; using 
student sarvlcsis; communicating with peere, faculty, and 
staff; and academic goal setting. Activities will include 
developing g^oup dynamics, role-playing, videotaping, dis- 
cussing in tsresf surveys, aeeertlveaces training, and inter- 
acting with gua at spnakere. 



Special Tonics Offsrlnas 

1. Mathematics Review 
Counselor: Hard Stewart 
Tias Commitment: 3 hours par waak v r 
Descriptions Voder supervision, students will work individually in the ' 
Cmntmr'* Learning Laboratory to learn or review natbamatice 
concepts pre- requisite to tfca courses they either ate enrolled 
in or intend to enroll in? For example, Math B students v^U 
have the opportunity to review deciaals, percentages, proper- , 
tione, s and geemstry; Rath D students wfH have the opportunity 
to review functions and baaie algebra, aa well aa gain additional / 
practice in preblest-solving for advanced slgsbra; opportuoitlse 
to review trigonosmnry and gain addition*! practice in solving / 
statistics problems will also be available. Students will take 
periodic examinations to ensure that they have meats red aa tsrial 
and will -meet weekly with LSC's Math Coordinator to review their 
progress . * * 

v.- 

2« Pre-Chemlstry workshop 
Counselor: Patricia Herthel 
Tims C^ealtment: 2 hours per week 

Description: Students who intend to enroll in Chemistry 1A during* their 
firat year will attend e weekly group Iscturt/discuasion of 
basic principles of chemistry. They will spend an additional 
hour of supervised problem* sol vina ssch week* Both a mid- term 
end a final examination will be given to determine the student 1 a 
readiness for Chemistry 1A. If necessary, individual conferences 
will also be arranged* r ; 

* . ... • . 
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3. vrlclas) Skills 

Counselors: Joan lothsteln cad Berbers Com ^ 
Tiaa Coaal taunt: 4 to 6 tear* par *tek 

Deeeripcion:, Student? wfli participate la supervised, icncimd writing 
jfractice and revision sessions, ss.m11 as receive eeaanti 
on chair perferaenee sal aa«t tedividielly vlch a writing 
apacUUac aach wees <e total of 4 beat*} . Zo addition, ' 
staaaaca aho lack knowladge of basic araaaar mil spend 1 to 
2 hears aach use*, depending upea chair need, doing self -paced 
saarclsss io Che Cantor's Learning Laboratory. 

4. Reading Strategies . » ■ 
Counselor: Corollas Tarnar 

Tiaa Coaaltaent: 3 hours par week 

Description: Both oo sa individual basis sad la groaps, itodancs will lsdrn 
- strscegles necessary Co reeding college casebooks effectively. 
Pre-recdleg techniques, eeaarahsnslov skills, and wsys to in- 
prove rstandoa vlll ha etreaeed. la addition, student* will 
learn bow to identify alaaaaca of ecntrsa orpanisaclea in ordar 

* l «° i»«raasa etudy-reading effectiveness. Vscsbalary laprove- 
aaat and race-buUdina M>n>i«M u4ii'w. —-.<—.* .1 



sad rata-buildlni asarelsas will' be assigned as necesssry. 

5. Voeabalary Developaent 

* Counselor: Catharine Frsond • * 
Tiaa Coaaitaant: 2 hours par week 

• Description: Studen ts will -learn words aost coasxmly' aaad in sesdeBlc dis- ' 

coarse. Itey will also lsarn eacfaeds for increasing vocabulary, 
such ss identifying aeaaing through the use of contest elues> 
affixes, sad roocs. Correct' use of prepositions will be stressed 
for students ahosa primary lsagusge la hot English. * " 



6. Language Skills 

Counselor! Miry Lowry 



Tiaa Coaadtaesfi 1 to. 1 boars par vaak 
Description: Vtudente will reed under 'supervision, prlasrlly « chair 
instructional level, in order. to develop fluency in under* 
■tending written aaterlals, Co increase vocabulary sad to 
learn strategies f or ^approaching readings sc various levels 
of difficulty. Students ahosa first language is not English 
will slso receive instruction is greaser, listening coapre- 
# * . hens ion, and pronunciation es needed. 
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Appendix C 



Mm of student 



SURVEY OF I8DIVIDUAIIZED 
STOW PftOBRAM PARTICIPANTS 
mi 1962 



> 



HELLO. JS 



THERE? 




1*. not available. Inquire: 



mCM UHERE/tMEfl I CAN REACH 



If person aoaverfng ft reluctant to 
glvo^nforeatlon, toll tbea: 

*lfy HAfK IS % 

I'm cau. ins vm m ucd vpict v ' . 

STUDENT AFFAIRS. WE'RE CWDUCTJHS A 
SURVEY OF PEOPtE WO PARTICIPATED IN 
THE INDIVIDUALIZED STOW PROGRAM AT 
IK WIS. 00 TOO KROU WHERE I CAR 

REACH f 

Mirit response on telephone log. 

Terminate call. 

teV 

'(If tiw port on has facta called five 
times with nt success, terataato efforts 
to roach then, and nark the log.) 



If 



to aval labia: 



SuSS w n t he err m „ 

AT (CO. ME 'RE DOING A SUR 



wmact i 
w Or sn 



n 

AFFAIRS 
STUDENTS 



If thfly did participate: 

' i " 

I'D LIRE TO ASK YOU' FOR TOUR REACTIONS TO UCO AND TO THE INDIVIDUAL 1?ED ITUDY FRflSRAfl Vflu 

AL^hp?*^^ OR 
ALL OF THESE QUESTIONS BUT, IF YOU W, YOUR aM5Kr$ HILL If CONFIDENTIAL. YOU'RE FREE TO 

HANG UP THE PHONE AT ANY TlHE OUR INS THE INTERVIEW IF YOU Tw^TOTmWoR ROT TW 

to^articipatei 1 w ^ * w, * r « l » mmmm: ffmium 

If not, ternlnate call with thanks and nerk loo. 
> If yes, continue on to the next page. 

u * - 



z 
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msons to read seven* st\tehent*that reflect nc goals of nun college students. 

CAN QKI TELLME MM IMPORTANT THESE COALS ARE TO TOU PERSONALLY? («« *t foiling 

NOT IMPORTANT AT ALL (o) 
SONBMAT DWJRTART ( f) 

DEFINITELY IMPORTANT * "(2) 
ONE OF THE «ST IMPORTANT (3) * 

_ TO INCREASE NY KROMLEDGE AND (JRRRSJANDSK Dl AN ACADEMIC FIELD 
TO OBTAIN A DEGREE 

TO COMPLETE COtltSES NECESSARY TO TRANSFER TO ANO^jER INSTITUTION OR TO 

60 TO GRADUATE SCHOOL 
TO DISCOVER CAREER INTERESTS 
TO FORMULATE L0N6-TERM (tfra"ptANS AND/OR GOALS 
TO PREPARE FOR A CAREER V. 

' TO BECOME ACTIVELY INVOLVED IN STUDENT LIFE AND CAMPUS ACTIVITIES 

_ TO INCREASE MY .PARTICIPATION IN CULTURAL AND SOCIAL EVENTS 

TO MEET PEOPLE* 

TO INCREASE MY SELF-CONFIDENCE 

TO IMPROVE- MY LEADERSHIP SKILLS 

_ v TO DEVELOP MY ABILITY TO BE INDEPENDENT. SELF-RELIANT AMD ADAPTABLE 

CAR YOU THINK OF ANY OTHER GOALS THAT YOU HAW SET FOR YOUR COLLEGE EDUCATION THAT ' 
WEREN'T INCLUDED IN THE LIST I JUST READ? 



2 
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3. 1*8 like to mar Yam impressions of the Wue of the individualized study program. 



4. MKAT, IF ANYTHING, DIDN'T YOU SAIN THAT YOU FEEL YOU SHOULD HAVE? . 



i. , WHAT HERE/ARE THE MOST DIFFICULT PROBLEMS THAT YOU HAVE ENCOUNTERED SINCE BEING AT 
UCO? 



6. WAX HERE THE BIGGEST PROBLEMS YOU FEEL YOU NAD TO RESOLVE BEFORE COMING TO UCDt 



f. HERE YOU EMPLOYED DURING THE«LAST TWO QUARTERS? 
HOW MANY HOURS A HEEK OIO YOU NCR*? 



Y«$ 



NO 



»- DO YOU THINK THAT YOU HAVE ACHIEVED ANY OF YOUR GOALS SINCE YOU HAVE BEEN 
AT UCD7 YtS Mo 



I. IF YOU HAD NOT PARTICIPATED IN THE INDIVIDUALIZED STUDY PROGRAM, DO YOU THINK YOUR 
LAST TWO QUARTERS AT UCO MOULD HAVE ftEN MUCH DIFFERENT? 



23 



25 



